Data transform method and apparatus, data processing method and apparatus, and program

ABSTRACT

When sample data is played back, audio guide data G 1  and G 2  and subsequent frame data are played back based on usage license information L 1  contained in the sample data. When high-quality data is generated, the audio guide data G 1  and G 2  and the usage license information L 1  are overwritten based on usage license information L 2  contained in additional data. When the high-quality data is played back, audio guide data G 1 ′ and G 2 ′ and subsequent frame data are played back based on usage license information L 3 . A user is then able to identify the playback status of the sample data or high-quality data by listening to an audio guide.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to data transform methods and apparatuses,data processing methods and apparatuses, and programs. Moreparticularly, the invention relates to a data transform method andapparatus, a data processing method and apparatus, and a programtherefor, which are suitable for distributing sample data (trial data)of content to users.

2. Description of the Related Art

Due to widespread use of communication network technologies includingthe Internet, improvements in information compression techniques, andenhanced integration or density of information recording media, paydistribution of digital content including various multimedia data, suchas audio, still images, moving pictures, and a combination of audio andmoving-pictures, for example, movies, to users are conducted viacommunication networks.

A store that sells package media, such as compact disks (CDs) orMini-Disks (MDs)™, that is, recording media in which digital content isrecorded, is installed with an information terminal, a so-calledmultimedia kiosk (MMK), in which many pieces of digital contentincluding music data are stored. This enables the store not only to sellpackage media, but also to sell digital content.

A user brings a recording medium, such as an MD, and inserts it into theMMK. The user then selects the title of digital content to be purchasedby referring to a menu screen, and pays for the content. Payment may bemade by cash, electronic money, or electronic settlement by a creditcard or a prepaid card. The MMK records the selected digital contentdata on the recording medium inserted by the user by performingpredetermined processing.

As described above, digital content sellers can sell digital content byusing the MMK, and can also distribute digital content to users via, forexample, the Internet.

Content can be distributed more effectively not only by selling packagemedia having content recorded thereon, but also by selling digitalcontent itself.

In order to distribute digital content while protecting the copyright,techniques, for example, those disclosed in Japanese Unexamined PatentApplication Publication Nos. 2001-103047 and 2001-325460 can be used.Portions of digital content other than portions that are permitted topreview or listen to on a trial basis are encrypted, and the digitalcontent is distributed. Then, only users who have purchased a decryptionkey for the corresponding encryption are permitted to preview or listento the entire content. As a known encryption method, the initial valueof a random number sequence is given to a bit string of a pulse codemodulation (PCM) digital audio signal as a key signal, and a bit stringobtained by performing an exclusive-OR of the generated 0/1 randomnumber sequence and the above-described PCM bit string is used as anencrypted bit stream. The digital content encrypted as described aboveis recorded on a recording medium by using, for example, theabove-described MMK, or is transmitted via a network to be distributedto a user. Unless the user who has obtained the digital content data hasa key, the user is only permitted to preview or listen to an unencryptedportion. If the encrypted portion is played back without beingdecrypted, only noise is heard.

There have been improvements in techniques for compressing audio dataand broadcasting it, distributing audio data via-a network, andrecording compressed data on various recording media, such asmagneto-optical disks.

There are various techniques for coding audio signals with highefficiency. For example, in a block-less frequency-band divisiontechnique, i.e., a so-called “sub-band coding (SBC)”, an audio signal inthe time domain is divided into a plurality of frequency bands and codedwithout dividing them into blocks. In a block frequency-band divisiontechnique, i.e., a so-called “transform coding”, a signal in the timedomain is transformed (spectrum transform) into a signal in thefrequency domain so as to be divided into a plurality of frequencybands. The signal components are then coded in each band. Anotherhigh-efficiency coding technique, which is a combination of theabove-described sub-band coding and transform coding, has also beenconsidered. In this case, for example, after sub-band division isperformed in the above-described SBC, signal components in each sub bandare transformed into signal components in the frequency domain, and arethen coded in each band.

Filters used in the above-described high-efficiency coding methodsinclude quadrature mirror filters (QMF), details of which are describedin R. E. Crochiere, “Digital Coding of Speech in Subbands” (Bell Syst.Tech. J., vol. 55, No. 8, 1974). An equal-bandwidth filtering techniqueis described in Joseph H. Rothweiler, “Polyphase Quadrature Filters—aNew Subband Coding Technique” (ICASSP 83, BOSTON).

As the above-described spectrum transform, for example, an input audiosignal is formed into blocks in predetermined time units (frames), anddiscrete Fourier transform (DFT), discrete cosine transform (DCT), ormodified DCT (MDCT) is performed on the signal components in each block,thereby transforming a time-domain signal into a frequency-domainsignal. Details of MDCT are described in J. P. Princen and A. B.Bradley, (Univ. of Surrey, Royal Melbourne Inst. of Tech.),“Subband/Transform Coding Using Filter Bank Designs Based on Time DomainAliasing Cancellation” (ICASSP 1987).

In the spectrum transform using the above-described DFT or DCT, when thespectrum transform is performed in a time block consisting of M samples,M items of independent real-number data are obtained. Generally, inorder to reduce distortion at the connections between time blocks, oneblock overlaps with each of the adjacent blocks by N/2 samples, andthus, a total of N samples are overlapped with the two adjacent blocks.On average, in DFT or DCT, M items of real-number data are quantized andcoded for (M+N) samples.

In contrast, in the spectrum transform using the above-described MDCT,when the spectrum transform is performed in a time block consisting of Msamples, M items of real-number data is obtained. One block overlapswith each of the adjacent blocks by M/2 samples, and thus, a total of Msamples are overlapped with the two adjacent blocks. Accordingly, inMDCT, M items of real-number data are obtained from 2M samples. Onaverage, in MDCT, M items of real-number data are quantized and codedfor M samples.

In a decoding apparatus, coded data obtained by performing MDCT isinverse-transformed in each block, and the resulting waveform componentsare added together while interfering with each other so as toreconstruct a waveform signal.

Generally, the spectrum frequency resolution is enhanced as the timeblock for spectrum transform becomes longer, thereby allowing energy tobe concentrated in specific spectral components. As described above, inMDCT, the spectrum transform is performed with an increased block lengthby overlapping samples between adjacent blocks, and the number ofspectral signal components remains the same as the original number ofsamples. By using such MDCT, coding can be performed with higherefficiency than by using DFT or DCT. Also, by allowing a sufficientlylong overlapping portion between adjacent blocks, inter-block distortionof the waveform signal can be reduced.

By quantizing signal components divided into sub bands by using a filteror spectrum transform, bands in which quantizing noise is generated canbe controlled, and high-efficiency coding can be performed by utilizingthe masking effect; Before performing quantizing, if signal componentsin each band are normalized by the maximum of the absolute values of thesignal components in the corresponding band, higher efficiency codingcan be performed.

When quantizing signal components divided into frequency bands, thebandwidths may be determined by considering, for example, human acousticcharacteristics. That is, generally, an audio signal may be divided intoa plurality of bands (for example, 25 bands) so that the bandwidth ofthe higher bands, which are referred to as the “critical bands”, becomesgreater.

When the bandwidths are determined so that the bandwidth of criticalbands becomes greater, data in each band is coded according to apredetermined bit distribution or an adaptive bit allocation.

It is now assumed, for example, that coefficient data obtained by theabove-described MDCT processing is coded by an adaptive bit allocation.In this case, the number of bits are adaptively allocated to MDCTcoefficient data in each band, and the MDCT coefficient data is thencoded. The following two bit allocation techniques are known.

One technique is disclosed in R. Zelinski and P. Noll, “AdaptiveTransform Coding of Speech Signals” (IEEE Transactions of Acoustics,Speech, and Signal Processing, Vol. ASSP-25, No. 4, August 1977). Inthis technique, bit allocation is performed according to the magnitudeof the signal in each band, and thus, the quantizing noise spectrumbecomes flat to minimize the noise energy. However, since the maskingeffect is not employed, the actual sound is not acoustically optimal forreducing noise.

The other technique is disclosed in M. A. Kransner (MassachusettsInstitute of Technology), “The Critical Band Coder—Digital Encoding ofthe Perceptual Requirements of the Auditory System” (ICASSP 1980). Inthis method, by utilizing the masking effect, fixed bit allocation isperformed for determining a signal-to-noise (S/N) ratio required foreach band. However, due to the fixed bit allocation, even when thecharacteristic of a sinusoidal wave input is measured, a precise valuecannot be obtained.

In order to overcome the above drawbacks, the following high-efficiencycoding apparatus has been proposed. All the bits available to bitallocation are divided into bits for fixed bit allocation and bits foradaptive bit allocation. The division ratio of the two types of bitallocations is determined by an input signal, and the division ratio ofthe fixed bit allocation becomes higher as the signal spectrum becomessmoother.

According to the above-described coding apparatus, many bits can beallocated to blocks containing specific spectral components, such assinusoidal waves, in which energy is concentrated, thereby making itpossible to considerably improve the overall S/N ratio characteristics.Generally, the human acoustic characteristics are extremely sensitive tosignals having sharp spectral components. Accordingly, an improved S/Nratio by using this method is effective not only in enhancing precisemeasurements, but also in improving the sound quality.

Many other bit allocation techniques have been proposed. Because ofincreasingly precise acoustic models and higher performance of codingapparatuses, even higher efficiency coding is possible not only in termsof measured values, but also for human acoustic characteristics. Inthese methods, the bit-allocation real-number reference value isdetermined so that the calculated S/N ratio can be achieved asfaithfully as possible, and the integer approximating the referencevalue is used as the number of allocation bits.

In Japanese Patent Application No. 5-152865 or WO94/28633 filed by thepresent inventors, another coding method has been proposed in which tonecomponents that are particularly important in an acoustic sense, i.e.,signal components in which energy is concentrated, are extracted from aspectrum signal, and are separately coded from the other spectralcomponents. According to this coding method, audio signals can beefficiently coded with a high compression ratio with very littledegradation.

In forming code strings, quantizing-precision information andnormalizing-coefficient information are first coded with a predeterminednumber of bits in each band, and the resulting normalized and quantizedspectrum signal is coded. A high-efficiency coding method in which thenumber of bits representing the quantizing precision differs accordingto the band is described in ISO/IEC 11172-3: 1993(E), 1933. In thisstandard, the number of bits indicating the quantizing-precisioninformation becomes smaller as the band becomes higher.

Instead of directly coding quantizing precision information, thequantizing-precision information may be determined from thenormalizing-coefficient information in a decoding apparatus. Accordingto this method, however, the relationship between thenormalizing-coefficient information and the quantizing-precisioninformation is determined when the standard is set, which makes itimpossible to introduce the quantizing precision based on more preciseacoustic models in the future. Additionally, if the compression ratiohas a range, the relationship between the normalizing-coefficientinformation and the quantizing-precision information has to bedetermined according to each range.

Another known coding method is disclosed in D. A. Huffman, “A Method forConstruction of Minimum Redundancy Codes” (Proc. I.R.E., 40, p. 1098,1952). In this method, a quantized spectrum signal is coded moreefficiently by using variable codes.

The signal coded as described above can be encrypted and distributed, asin PCM signals, in which case, those who have not obtained thecorresponding key are unable to play back the original signal.Alternatively, instead of encrypting a coded bit string, a PCM signalmay be transformed into a random signal, which is then coded forcompression. It is also impossible for users who have not obtained thecorresponding key to play back the original signal, and only noise isheard.

Distribution of sample data (trial data) of content data promotes salesof the content data. The sample data includes data to be played backwith lower quality than the original data and data for playing back partof the original data (for example, only refrains of an original piece ofmusic). A user plays back the sample data, and if the user likes it, theuser purchases a key for decrypting the encrypted data to play back theoriginal content data. Alternatively, the user purchases originalcontent data or a recording medium in which the original content data isrecorded.

In the above-described content protection methods, however, the entiredata cannot be played back, or only noise is heard. Accordingly, thesemethods cannot be used for, for example, distributing recording mediastoring audio data recorded with a relatively low audio quality assample data. Even if data scrambled by one of the above-describedmethods is distributed to a user, the user is unable to understand thecontent of the data.

When encrypting signals subjected to high-efficiency coding, it is verydifficult to maintain the compression efficiency while providing codestrings that are meaningful for regular playback means. That is, when acode string generated by performing high-efficiency coding is scrambledand is then played back, as described above, only noise is heard, andalso, playback means may not operate at all if the scrambled code stringis not compatible with the original high-efficiency code standard.

Also, when a scrambled PCM signal is coded with high efficiency and theamount of information is reduced by utilizing the acousticcharacteristics, coding becomes irreversible. Accordingly, the scrambledPCM signal cannot be correctly reconstructed when the coded signal isdecoded. Thus, it is very difficult to descramble the signal.

Therefore, a method for precisely descrambling the signal must beemployed by sacrificing the compression efficiency.

Japanese Unexamined Patent Application Publication No. 10-135944(corresponding to U.S. Pat. No. 6,081,784) filed by the presentinventors discloses the following audio coding method. In this method,among spectral signal components coded from a music signal, signalcomponents only in higher bands are encrypted and are distributed assample data, thereby enabling users to play back unencrypted signalcomponents in a narrow band without a corresponding key. In this method,signal components only in higher bands are encrypted, and also,high-band bit allocation information is replaced by dummy-data, true bitallocation information being recorded at a position ignored by playbackdecoders.

According to this method, a user receives the distributed sample data,plays it back, and then purchases a key for decrypting the sample datathat the user likes, into the original data. The user is then able toplay back a desired piece of music correctly in all the bands and enjoythe music with high sound quality.

Some content providers desire to restrict the use of sample dataobtained by one of the above-described known methods for the purpose ofundertaking temporary sales promotion before starting to sell thecontent. The users who have obtained the sample data based on theabove-described known methods are, however, disadvantageously able toutilize the sample data without limitations.

In order to overcome this drawback, a method for controlling a playbackoperation of sample data disclosed in Japanese Unexamined PatentApplication Publication No. 2001-282258 has been proposed. This methodenables copyright holders to restrict the use of sample data based onconditions, such as the date, period, the number of uses, and the timefor the user is allowed to preview or listen to the sample data.

If the playback operation of sample data is restricted by variousconditions as described above, a user must know the status of the sampledata, for example, whether the sample data can be played back or untilwhen the sample data can be played back. For example, if content ismusic data and the use of such data is restricted by the period, sampledata that has expired the period cannot be played back. In this case,the user must find the reason why the music data cannot be played backthrough a display device provided for a playback apparatus.

However, the user is not able to recognize that the sample data hasexpired unless the user checks with the display device, or the user mayconsider that the playback device has broken down.

SUMMARY OF THE INVENTION

Accordingly, in view of the above-described background, it is an objectof the present invention to distribute, together with usage licenseinformation and audio guide data, sample data in which part of originaldata is replaced by dummy data and small-volume additional datacontaining true values of the dummy data, and to change a data zone tobe played back based on the usage license information when the sampledata and the additional data are utilized, so that the audio guide databased on the status of the usage of the content can be played back.

In order to achieve the above-described object, according to one aspectof the present invention, there is provided a data transform methodincluding: a replacement step of replacing first data contained in afirst data string by second data; a first generation step of generatinga second data string by using data generated in the replacement step;and a usage-license information addition step of adding, to the seconddata string, first usage license information including informationindicating at least one condition for permitting the use of at leastpart of the second data string and information indicating the seconddata string which is permitted to be used based on at least onecondition. When the second data string is used, the second data stringwhich is permitted to be used is utilized based on the first usagelicense information.

According to another aspect of the present invention, there is provideda data transform apparatus including: a replacement unit for replacingfirst data contained in a first data string by second data; a generatorfor generating a second data string by using data generated by thereplacement unit; and a usage-license-information adder for adding, tothe second data string, usage license information including informationindicating at least one condition for permitting the use of at leastpart of the second data string and information indicating the seconddata string which is permitted to be used based on at least onecondition. When the second data string is used, the second data stringwhich is permitted to be used is utilized based on the usage licenseinformation.

According to still another aspect of the present invention, there isprovided a computer-executable program for controlling a data transformapparatus that transforms a first data string into a second data string.The computer-executable program includes: a replacement step ofreplacing first data contained in the first data string by second data;a generation step of generating the second data string by using datagenerated in the replacement step; and a usage-license-informationaddition step of adding, to the second data string, usage licenseinformation including information indicating at least one condition forpermitting the use of at least part of the second data string andinformation indicating the second data string which is permitted to beused based on at least one condition. When the second data string isused, the second data string which is permitted to be used is utilizedbased on the usage license information.

According to the present invention, data strings can be transformed.Before distributing sample data in which part of original data isreplaced by dummy data and small-amount additional data containing thetrue value of the dummy data, usage license information and audio guidedata are added. By specifying coded frames (including audio data) thatcan be played back based on various conditions, audio guide-data can beswitched and played back according to the usage status of content.

According to a further aspect of the present invention, there isprovided a data processing method including: a usage-license-informationmanagement step of managing usage license information includinginformation indicating at least one condition for permitting at leastpart of a sixth data string to be played back or recorded andinformation indicating the sixth data string which is permitted to beplayed back or recorded based on at least one condition; and a dataprocessing step of playing back or recording the sixth data string whichis permitted to be played back or recorded based on the usage licenseinformation.

According to a yet further aspect of the present invention, there isprovided a data processing apparatus including: ausage-license-information manager for managing usage license informationincluding information indicating at least one condition for permittingat least part of a predetermined data string to be played back orrecorded and information indicating the predetermined data string whichis permitted to be played back or recorded based on at least onecondition; and a data processor for playing back or recording thepredetermined data string which is permitted to be played back orrecorded based on the usage license information.

According to a further aspect of the present invention, there isprovided a computer-executable program for controlling a data processingapparatus that plays back or records a predetermined data string. Thecomputer-executable program includes: a usage-license-informationmanagement step of managing usage license information includinginformation indicating at least one condition for permitting at leastpart of a predetermined data string to be played back or recorded andinformation indicating the predetermined data string which is permittedto be played back or recorded based on at least one condition; and adata processing step of playing back or recording the predetermined datastring which is permitted to be played back or recorded based on theusage license information.

With this configuration, data strings can be played back or recorded byreferring to usage license information, and also, data can bereconstructed by using different data strings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating the configuration of a datadistribution system to which the present invention is applied;

FIG. 2 is a block diagram illustrating the configuration of a codingdevice to which the present invention is applied;

FIG. 3 is a block diagram illustrating the configuration of atransformer shown in FIG. 2;

FIG. 4 illustrates a spectrum signal and a quantizing unit;

FIG. 5 is a block diagram illustrating the configuration of a signalcomponent coder shown in FIG. 2;

FIG. 6 illustrates tone components and non-tone components;

FIG. 7 is a block diagram illustrating the configuration of atone-component coder shown in FIG. 5;

FIG. 8 is a block diagram illustrating the configuration of anon-tone-component coder shown in FIG. 5;

FIG. 9 illustrates the format of a frame of original data;

FIG. 10 is a block diagram illustrating the con figuration of a dataseparator shown in FIG. 2;

FIG. 11 illustrates the format of a sample frame;

FIG. 12 illustrates a spectrum signal corresponding to the sample frameshown in FIG. 11;

FIG. 13 illustrates an additional frame;

FIG. 14 illustrates the structures of sample data, additional data, andhigh-quality data;

FIGS. 15 and 16 are a flowchart illustrating sample-data generationprocessing;

FIG. 17 is a block diagram illustrating the configuration of a dataplayback device to which the present invention is applied;

FIG. 18 is a block diagram illustrating the configuration of a signalcomponent decoder shown in FIG. 17;

FIG. 19 is a block diagram illustrating the configuration of atone-component decoder shown in FIG. 18;

FIG. 20 is a block diagram illustrating the configuration of anon-tone-component decoder shown in FIG. 18;

FIG. 21 is a block-diagram illustrating the configuration of an inversetransformer shown in FIG. 17;

FIG. 22 is a flowchart illustrating sample-data playback processing;

FIGS. 23 and 24 are a flowchart illustrating high-quality playbackprocessing;

FIG. 25 is a flowchart illustrating code-string reconstructionprocessing;

FIG. 26 is a block diagram illustrating the configuration of a datarecording device to which the present invention is applied;

FIGS. 27 and 28 are a flowchart illustrating data recording processing;and

FIG. 29 is a block diagram illustrating the configuration of a personalcomputer.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention is described in detail below with reference to theaccompanying drawings through illustration of an embodiment.

FIG. 1 is a block diagram illustrating the configuration of a datadistribution system according to the present invention.

A coding device 2 generates, from original content data, low-qualitysample data and additional data that contains data required forreconstructing the original data, from the sample data, encrypts thesedata if necessary, and supplies them to a distribution server 3.

The distribution server 3 distributes the sample data supplied from thecoding device 2 to a data playback device 5 or a data recording device6, which are utilized by a plurality of users, as pay data or free datavia a network 1, which is wired or wireless means, for example, theInternet. Although only one data playback device 5 and one datarecording device 6 are shown in FIG. 1, a plurality of data playbackdevices 5 and data recording devices 6 may be connected to the network1.

A user plays back the sample data by using the data playback device 5 topreview or listen to it, or records the sample data in a predeterminedrecording medium by using the data recording device 6, and then plays itback. If the user likes the content and desires to purchase it, the userobtains additional data corresponding to the sample data from thedistribution server 3 and decrypts data, if it is encrypted, so as toreconstruct the original data. The sample data can be provided free ofcharge or for an amount of money smaller than that required forpurchasing the additional data. If the sample data is charged for,required accounting processing is performed in an accounting server 4.

If the user desires to purchase pay sample data or additional data, theuser accesses the accounting server 4 to conduct payment settlementbefore receiving the data. Accordingly, the distribution server 3distributes data requested by the user after receiving a message fromthe accounting server 4 that payment settlement has been completed.

FIG. 2 is a block diagram illustrating the configuration of the codingdevice 2 for generating sample data in response to the input of anacoustic waveform signal.

It is how assumed that, in response to the input of a digital signal,such as an audio PCM signal, the coding device 2 performshigh-efficiency coding by conducting sub-band coding (SBC), adaptivetransform coding (ATC), or adaptive bit allocation. ATC is a codingmethod in which, bit allocation is adaptively performed based on, forexample, DCT. More specifically, an input signal is transformed intospectrum signal components in units of time blocks, and the spectrumsignal components in each band are normalized together. That is, eachspectrum signal component is divided by a normalizing coefficient forapproximating the maximum signal component. Then, the resulting signalcomponents are quantized with a quantizing precision which is suitablydetermined by the characteristics of the signal components, and thequantized signal components are then coded.

In FIG. 2, upon receiving an acoustic waveform signal, a transformer 11transforms the acoustic waveform signal into signal frequency componentsand outputs them to a signal component coder 12. The signal componentcoder 12 codes the received signal frequency components, and outputsthem to a code-string generator 13. The code-string generator 13generates a code string from the coded signal frequency components, andoutputs it to a data separator 14. The data separator 14 performspredetermined processing, for example, changing normalizing-coefficientinformation or inserting sample-data time information, on the codestring input from the code-string generator 13 so as to transformcontent data (original data) that can be played back with high qualityinto sample data. The data separator 14 also generates additional data(reconstruction data) associated with the sample data, which is sold toa user who desires to reconstruct or play back the original data. Then,the data separator 14 outputs the sample data and the additional data.

FIG. 3 is a block diagram illustrating the detailed configuration of thetransformer 11.

An acoustic waveform signal input into the transformer 11 is dividedinto signal components in two bands by a band-division filter 21, andthe signal components are output to forward spectrum transformers 22-1and 22-2. The forward spectrum transformers 22-1 and 22-2 transform thesignal components into spectrum signal components by using, for example,MDCT, and outputs them to the signal component coder 12. The bandwidthof the signal components input into the forward spectrum transformers22-1 and 22-2 is one half the bandwidth of the signal input into theband-division filter 21. The signal input into the band-division filteris also reduced to one half.

In the transformer 11 shown in FIG. 3, the signal components dividedinto two bands by the band-division filter 21 are transformed intospectrum signal components by using MDCT. Another method may be employedfor transforming an input signal into spectrum signal components. Forexample, an input signal may be transformed into spectrum signalcomponents by using MDT without being divided into bands. Alternatively,the forward spectrum transformers 22-1 and 22-2 may transform the inputsignal into spectrum signal components by using DCT or DFT.

Although an input signal can be divided into band signal components byusing a band-division filter, it is preferably transformed into spectrumsignal components by using MDCT, DCT, or DFT, which allows manyfrequency components to be computed with a relatively small amount ofcomputation.

Although in FIG. 3 the input acoustic waveform signal is divided intotwo bands in the band-division filter 21, it may be divided into threeor more bands. Information concerning the number of bands divided in theband-division filter 21 is output to the code-string generator 13 viathe signal component coder 12.

FIG. 4 illustrates a spectrum signal obtained by transforming theabsolute values of the spectrum signal components subjected to MDCTprocessing by the transformer 11 into power levels.

The acoustic waveform signal input into the transformer 11 istransformed into, for example, 64 spectrum signal components in units ofpredetermined time blocks. These spectrum signal components are dividedinto 16 bands, such as [1] through [16] indicated by solid rectangles inFIG. 4, according to processing, which are described below, by thesignal component coder 12, and the spectrum signal components in eachband are then quantized and normalized. A set of spectrum signalcomponents divided into 16 bands, that is, a set of spectrum signalcomponents to be subjected to quantization and normalization together,is a quantizing unit.

By changing the quantizing precision in each quantizing unit based onthe distribution of frequency components, high-efficiency coding can beperformed with very little degradation of the audio quality perceptibleto human ears. Thus, when coding acoustic waveform signals, codingparameters, such as quantizing precision, can be controlled to improvethe coding efficiency by utilizing human acoustic characteristics.

FIG. 5 is a block diagram illustrating the detailed configuration of thesignal component coder 12. In the signal component coder 12 shown inFIG. 5, tone components that are particularly important in an acousticsense, i.e., signal components having energy concentrated in specificfrequencies, are extracted from the input spectrum signal, and areseparately coded from the other spectrum components.

A spectrum signal received from the transformer 11 is separated intotone components and non-tone components by a tone-component separator31. The tone components are output to a tone-component coder 32, and thenon-tone components are output to a non-tone-component coder 33.

Tone components and non-tone components are described in detail belowwith reference to FIG. 6. It is now assumed that the spectrum signalinput into the tone-component separator 31 is the signal shown in FIG.6. In this case, signal components having high power levels areseparated from non-tone components as tone components 41 through 43.Position data P1 through P3 indicating the positions of the separatedtone components 41 through 43 and the bandwidths of the tone components41 through 43 are detected and output to the tone-component coder 32together with the tone components 41 through 43.

Tone components may be separated by using, for example, the methoddisclosed in Japanese Patent Application No. 5-152865, WO94/28633, orU.S. Pat. No. 5,717,821 filed by the present inventors. The tonecomponents and the non-tone components separated by this method arequantized with different numbers of bits by the processing of thetone-component coder 32 and the non-tone-component coder 33,respectively, which are described below.

The tone-component coder 32 and the non-tone-component coder 33 code thereceived signal components. The tone-component coder 32 quantizes thetone components with a greater number of bits, i.e., with an increasedlevel of quantizing precision, while the non-tone-component coder 33quantizes the non-tone components with a smaller number of bits, i.e.,with a decreased level of quantizing precision.

Although it is necessary to add information concerning, for example, thepositions and the bandwidths of the extracted tone components, to thetone components, non-tone components can be quantized with a smallernumber of bits. In particular, if an acoustic waveform signal input intothe coding device 2 is a signal having energy concentrated in specificfrequencies, it can be coded effectively with a high compression ratiowith very little degradation in an acoustic sense.

FIG. 7 is a block diagram illustrating the detailed configuration of thetone-component coder 32.

A normalizer 51 receives tone components in each quantizing unit,normalizes them, and outputs the normalized components to a quantizer52. A quantizing-precision determining portion 53 calculates thequantizing precision by referring to the quantizing unit of an inputspectrum signal, and outputs the calculation result to the quantizer 52.Since the quantizing unit is formed of tone components, thequantizing-precision determining portion 53 performs calculations toincrease the quantizing precision. The quantizer 52 quantizes thenormalized result input from the normalizer 51 with the quantizingprecision determined by the quantizing-precision determining portion 53so as to generate codes. The quantizer 52 also outputs codinginformation, such as normalizing-coefficient information andquantizing-precision information, together with the generated codes.

The tone-component coder 32 also codes position information concerningthe positions of the tone components, which is input together with thetone components, and outputs the coded information.

FIG. 8 is a block diagram illustrating the detailed configuration of thenon-tone-component coder 33.

A normalizer 54 receives non-tone components in each quantizing unit,normalizes them, and outputs the normalized components to a quantizer55. A quantizing-precision determining portion 56 calculates thequantizing precision by referring to the quantizing unit of an inputspectrum signal, and outputs the calculated result to the quantizer 55.Since the input quantizing unit is formed of non-tone components, thequantizing-precision determining portion 56 performs calculations todecrease the quantizing precision. The quantizer 55 quantizes thenormalized result input from the normalizer 54 with the quantizingprecision determined by the quantizing-precision determining portion 56so as to generate codes. The quantizer 55 also outputs codinginformation, such as normalizing-coefficient information andquantizing-precision information, together with the generated codes.

The coding efficiency achieved by the above-described coding method canbe further improved. For example, variable-length coding is used, andamong quantized-spectral components, a relatively short code length canbe assigned to signal components which appear with higher frequency, anda relatively long code length can be assigned to signal components whichappear with lower frequency so as to decrease the entropy of the codes,thereby enhancing the coding efficiency.

Then, the code-string generator 13 shown in FIG. 2 generates a codestring consisting of a plurality of frames that can be recorded in arecording medium or transmitted to another information processingapparatus via a data transmission channel from the codes of the signalfrequency components output from the signal component-coder 12, andoutputs the code string to the data separator 14. The code stringgenerated by the code-string generator 13 is audio data that can beplayed back with high quality by regular decoders.

FIG. 9 illustrates an example of the frame format of audio data that isgenerated by the code-string generator 13 and that can be played backwith high quality.

At the head of each frame, a fixed-length header containing asynchronizing signal is disposed. The header also contains the number ofbands divided in the band-division filter 21 of the transformer 11described with reference to FIG. 3.

In each frame, after the header, tone-component information concerningseparated tone components is recorded. The tone-component informationincludes the number of tone components (3 in this example), the tonewidth, and information concerning the quantizing precision used forquantizing the tone components by the tone-component coder 32 shown inFIG. 7. Subsequently, the tone-component information includes data ofthe tone components 41 through 43, such as the normalizing coefficients,the tone positions, and the spectrum coefficients. In this example, forthe tone component 41, the normalizing coefficient is 30, the toneposition is P1, and the spectrum coefficient is SP1; for the tonecomponent 42, the normalizing coefficient is 27, the tone position isP2, and the spectrum coefficient is SP2; and for the tone component 43,the normalizing coefficient is 24, the tone position is P3, and thespectrum coefficient is SP3.

Subsequent to the tone-component information, non-tone-componentinformation is recorded. The non-tone-component information includes thenumber of quantizing units (16 in this example) and thequantizing-precision information, the normalizing-coefficientinformation, and the spectrum-coefficient information of each of the 16quantizing units when the non-tone components are coded by thenon-tone-component coder 33 shown in FIG. 8. As the quantizing-precisioninformation, the value of 4 is assigned to the quantizing unit [1] inthe lowest band, and the value of 4 is assigned to the quantizing unit[16] in the highest band. As the normalizing-coefficient information,the value of 46 is assigned to the quantizing unit [1] in the lowestband, and the value of 8 is assigned to the quantizing unit [16] in thehighest band. As the normalizing-coefficient information, valuesproportional to the dB values of the power levels of the spectrum signalare used. If the length of the content frame is fixed, a space may becreated after the spectrum-coefficient information.

FIG. 10 is a block diagram illustrating the detailed configuration ofthe data separator 14 shown in FIG. 2.

A controller 61 obtains setting data, such as a permitted zone of thesample data and usage license information, and audio guide data, whichare input from an external operation input unit (not shown), andcontrols a band-restriction processor 63. The controller 61 alsocontrols a usage-license information adder 68. The setting data, such asthe sample zone of the sample data and the usage license information,and the audio guide data may be prestored in a recorder (not shown), andthe controller 61 may obtain such data when necessary.

According to the information of the sample zone of the sample data(start position, zone length, band, etc.) input from the controller 61,the band-restriction processor 63 generates, from the coded frames ofthe input original data, data restricted in the designated band (sampleband) based on the designated number of coded frames (sample zonelength) from the designated position (start position). For example,among the spectrum data shown in FIG. 6, the normalizing coefficients ofsome quantizing units in the higher band are minimized so that onlylower frequency band can be decoded, thereby decreasing the quality ofthe content to be played back.

It is now assumed that sample data is generated by setting the sampleband to be quantizing units [1] through [12]. In this case, thecontroller 61 informs the band-restriction processor 63 that thequantizing units contained in the sample band are [1] through [12], andthe band-restriction processor 63 minimizes the values of thenormalizing coefficient information of the quantizing units [13] through[16], as shown in FIG. 11, and also outputs the true values of thenormalizing coefficient information of the quantizing units [13] through[16] to an additional-frame generator 65.

As in the non-tone components, the band-restriction processor 63minimizes the normalizing coefficients of the portions of the tonecomponents outside the sample band, and outputs the true values to theadditional-frame generator 65.

The spectrum signal obtained by playing back the sample data shown inFIG. 11 is shown in FIG. 12. Since the values of thenormalizing-coefficient information of the quantizing units [13] through[16] are minimized in the band-restricted coded frames (sample frames),the non-tone spectrum signal components contained in such quantizingunits are also minimized. The spectrum signals of the two tonecomponents 42 and 43 contained in the quantizing units [13] through [16]are also minimized. That is, when decoding and playing back the sampledata, only the narrow-band spectrum signal components in the quantizingunits [1] through [12] are played back.

Although in the example in FIG. 11 the sample band is set to be thequantizing units [1] through [12], the sample band may vary in eachframe. Additionally, all the normalizing coefficients of the non-tonecomponents and the tone components may be minimized (i.e., the sampleband is zero), in which case, the sample frame can be muted.

The processing for decreasing the quality of an original coded frame togenerate a sample frame may be applied to all the coded frames.Alternatively, it may be applied to frames in one part of the content,or to frames in a plurality of parts of the content. When decreasing thequality of frames in more than one part, the frames other than those inthe designated parts are muted, thereby preventing the original codedframes from being contained in the sample data.

According to the above-described technique, when the sample data isplayed back, only the narrow-band spectrum signal is played back withlow quality, or no sound is heard. Thus, the sample data is played backwith lower quality compared to the original data shown in FIG. 9.

Since the normalizing coefficients of the non-tone components areminimized, spectrum-coefficient information higher than the positionindicated by Ad in FIG. 11 is minimized when playing back the sampledata. This makes it possible to record certain information in this area.

More specifically, a spectrum-information overwriter 64 writes randomdummy data into the spectrum coefficient information higher than theposition Ad in FIG. 11, and outputs the dummy data to a sample-datagenerator 66 as a sample frame. The spectrum-information overwriter 64outputs true spectrum-coefficient information replaced by the dummydata, and if necessary, information indicating the position of the dummydata, to the additional-frame generator 65.

Dummy data to replace the spectrum-coefficient information may bewritten in all the frames. Alternatively, it may be written into onlysome of the frames.

If variable-length coding is performed on the spectrum-coefficientinformation, and if the variable-length codes are sequentially recordedin the spectrum-coefficient information area from the lower band to thehigher band, part of the variable-length codes in the intermediate bandis missing, since the spectrum-coefficient information which isminimized when decoding the data is replaced with other information, forexample, dummy data. This makes it impossible to decode the higher-banddata including the intermediate-band data. That is, it is very difficultto reconstruct or play back the spectrum-coefficient information of theoriginal data outside the sample band contained in the sample datawithout using the true values of the dummy data indicated in theadditional frame. As a result, the security of the sample data can beenhanced.

When part of the normalizing-coefficient information is missing or whenpart of the spectrum-coefficient information is replaced by otherinformation, it is very difficult to predict the true data compared towhen a relatively short encryption key is deciphered. Illegalfalsification of the sample data results in a deterioration in the audioquality. Accordingly, it is very difficult for users who are notpermitted to play back original data to predict the original data basedon the sample data, thereby enhancing the protection of the copyright ofthe creator or the distributor of the content data.

Even if true values replaced by dummy data in sample data are predictedfrom the dummy data, there is no danger of expanding such damage toother content, unlike when an encryption algorithm is broken. Thus, ahigher level of security can be achieved compared to when content datais encrypted by using a specific algorithm and is distributed as sampledata.

Then, the true values of the normalizing-coefficient information of thenon-tone components and the tone components changed by theband-restriction processor 63, and the true values of part of thespectrum-coefficient information of the non-tone components overwrittenby the spectrum-coefficient information overwriter 64 are supplied tothe additional-frame generator 65, which is described below, and arerecorded in the additional data.

Instead of changing the normalizing-coefficient information of thequantizing units outside the sample band, the quantizing-precisioninformation of the quantizing units may be minimized. Alternatively, thequantizing-precision information may be minimized together with thenormalizing-coefficient information. In this case, the band-restrictionprocessor 63 supplies the true values of the changedquantizing-precision information to the additional-frame generator 65.

However, changing the normalizing-coefficient information is differentfrom changing the quantizing-precision information in terms of thesecurity level, that is, the difficulty in illegally predicting theoriginal data from the sample data without using the additional data.For example, when the original data is generated by using a bitallocation algorithm in which the quantizing-precision information iscalculated based on the normalizing-coefficient information, and if, inthis case, only the quantizing-precision information outside the sampleband is changed without changing the normalizing-coefficientinformation, the true values of the quantizing-precision information maybe predicted based on the normalizing coefficient information.

In contrast, it is difficult to predict the normalizing-coefficientinformation from the quantizing-precision information. It is thuspreferable that the normalizing-coefficient information be changed inview of security. By changing both the normalizing-coefficientinformation and the quantizing-precision information outside the sampleband, the possibility of the original data being illegally predictedbecomes extremely low. Alternatively, the normalizing-coefficientinformation or the quantizing-precision information outside the sampleband may be selectively changed in each frame of the sample data.

The additional-frame generator 65 generates each frame (additionalframe) forming additional data for increasing the quality of the sampledata based on the normalizing-coefficient information and thequantizing-precision information outside the sample band supplied fromthe band-restriction processor 63 and the spectrum coefficientinformation outside the sample band supplied from thespectrum-information overwriter 64. After previewing or listening tothis sample data, the user purchases this additional data, therebymaking it possible to reconstruct or play back the original data fromthe sample data.

FIG. 13 illustrates the format of an additional frame to be generated.As discussed with reference to FIG. 11, when the quantizing units usedin the sample band of the permitted zone are [1] through [12], thenormalizing-coefficient information (indicated by the correspondinghatched portion in FIG. 11) of the two tone-components contained in thequantizing units [13] through [16] and the four items ofnormalizing-coefficient information (indicated by the correspondinghatched portion in FIG. 11) of the quantizing units [13] through [16]are replaced by dummy data. Part of the spectrum-coefficient information(indicated by the corresponding hatched portion in FIG. 11) of thenon-tone components outside the sample band is also replaced by dummydata.

Upon receiving the true values corresponding to the dummy data of thenormalizing-coefficient information of the tone components and thenon-tone components changed by the band-restriction processor 63 andalso receiving the true Values and the position informationcorresponding to the dummy data of part of the spectrum-coefficientinformation of the non-tone components outside the sample band andchanged by the spectrum-information overwriter 64, the additional-framegenerator 65 generates the additional frame shown in FIG. 13.

That is, in the additional frame, information concerning the tonecomponents and information concerning the non-tone components arerecorded. In the additional frame shown in FIG. 13, the quantizing unitsused in the sample band are [1] through [12]. As the information of thetone components, the normalizing-coefficient information (in thisexample, the values 27 and 24) of the individual tone componentsreplaced by dummy data is recorded. As the information of the non-tonecomponents, the normalizing-coefficient information (in this example,the values 18, 12, 10, and 8) replaced by dummy data and thespectrum-coefficient information (in this example, HC) replaced by dummydata and the position information thereof (in this example, Ad) arerecorded.

In the example shown in FIG. 13, the position information of thespectrum-coefficient information replaced by dummy data in the sampleframe is indicated in the additional frame. However, the position atwhich the spectrum-coefficient information is replaced by dummy data canbe located at the head of the spectrum-coefficient information outsidethe sample band, thereby making it possible to determine the position ofthe spectrum-coefficient information replaced by dummy data from thenormalizing-coefficient information of the non-tone components replacedby dummy data. Accordingly, the position information can be omitted fromthe additional frame. On the other hand, if the position at which thespectrum-coefficient information replaced by dummy data is located afterthe head of the spectrum-coefficient information outside the sampleband, it is necessary to indicate the position information of thespectrum-coefficient information replaced by dummy data in theadditional frame, as shown in FIG. 13.

Also by indicating part of the information to be added to additionaldata in the space of a sample frame, the amount of the additional datacan be decreased. Thus, the time required for the user to recordadditional data in a recording medium by using MMK, or the time requiredfor downloading the additional data, can be decreased.

As described above, the signal component coder 12 of the coding device 2separates an input signal into tone components and non-tone components,and codes them separately. However, by using the non-tone-componentcoder 33 shown in FIG. 8 instead of the signal component coder 12, aninput signal may be coded without being separated into tone componentsand non-tone components. The resulting additional frame is without tonecomponent information, as shown in FIG. 13, and in this case, the amountof additional data can be decreased.

The sample-data generator 66 generates the header of sample data, andadds the generated header to the supplied sample frames so as togenerate the sample data. The sample-data generator 66 then supplies thesample data to the usage-license information adder 68. The header of thesample data contains information concerning, for example, a content IDfor identifying the content, the content playback time, the contenttitle, and the coding method.

An additional-data generator 67 generates the header of additional data,and adds the generated header to the supplied frames so as to generateadditional data. The additional-data generator 67 then supplies theadditional data to the usage-license information adder 68. The header ofthe additional data, includes information concerning, for example, thecontent ID for identifying the content to distinguish the additionaldata from the sample data, the content playback time, and the codingmethod, if necessary.

By using the setting data of the usage-license information and the audioguide data supplied from the controller 61, the usage-licenseinformation adder 68 adds the usage-license information and the audioguide data to both the sample data supplied from the sample-datagenerator 66 and the additional data supplied from the additional-datagenerator 67.

The usage-license information includes various conditions, such as theexpiry date, the period, the number of times the content can be used,and the time at which the content can be used, etc., thereby making itpossible to restrict the use of the content. That is, among coded framesof certain content C, by designating coded frames that can be, used whena certain condition A is satisfied, and by designating coded frames thatcan be used when the condition A is not satisfied, the use of thecontent C can be restricted. It is thus possible to set theusage-license information of the content C so that, for example, all thecoded frames can be played back when the condition “before the usageexpiry date” is satisfied, and none of the frames can be played backwhen the condition “before the usage expiry date” is not satisfied.

It is also possible to set a plurality of conditions in theusage-license information. For example, when the condition is set to be“less than the number of usage times and before the usage expiry date”,the content cannot be used if the maximum number of usage times has beenexceeded or if the usage expiry date has passed. Similarly, when thecondition is set to be “less than the number of usage times or beforethe usage expiry date”, the content cannot be used if the maximum numberof usage times has bee exceeded and if the usage expiry date has passed.

More detailed conditions can be set in the usage-license information.For example, conditions can be set to be “only one more usage” or“within three days-before the usage expiry date” for allowing thecontent to be used.

The audio guide data can be used under various conditions set in theusage-license information. Audio guidance, for example, “the remainingnumber of usage times is zero” or “the usage expiry date has passed”, isinformed to the user by sound.

The usage-license information or the audio guide data added to thesample data is used for restricting the use of the sample data or forindicating the usage status. In contrast, the usage-license informationor the audio guide data added to the additional data is used forupdating the counterparts added to the sample data. That is, byobtaining the additional data, the user who possesses the sample data isable to increase the quality of the sample data, and also to update theusage-license information or replaces the audio guide data. For example,by obtaining additional data with usage-license information, theoriginal data can be reconstructed from the sample data, and also,advertising audio data contained in the sample data can be erased, andthe usage-license information can be updated so that the number of usagetimes or the usage expiry date becomes unlimited.

The usage-license information adder 68 outputs the sample data withusage-license information and audio guide data, as stated above. Theusage-license information adder 68 also encrypts, if necessary, theadditional data with usage-license information and audio guide dataassociated with the sample data, and outputs the resulting additionaldata.

Accordingly, by using the sample data and the additional data generatedby the data separator 14, the original data can be reconstructedaccording to the processing described below.

Specific examples of sample data, additional data, and high-quality data(original data) are discussed below with reference to the datastructures shown in FIG. 14.

Sample data 71 shown in FIG. 14 includes a header containing the contentID (CID), sample frames M1 through M8, usage-license information L1, anda plurality of audio guide frames G1 through G4. The sample frames M1through M8 are generated by decreasing the quality of the coded framesof the original data, and the original data can be reconstructed fromthe sample frames M1 through M8 by using additional data 72, which isdescribed below.

In the example of the sample data 71 shown in FIG. 14, the audio guideframes G1 and G2 are generated by coding the speech “sample data can beplayed back”, and the audio guide frames G3 and G4 are generated bycoding the speech “sample data cannot be played back”.

The usage-license information L1 of the sample data 71 indicates atleast one license condition and the part of the coded frames that can beplayed back under each condition. In the example in FIG. 14, thecondition is set to be the number of playback times, and the part of thecoded frames that can be played back is indicated for both the contentdata and the audio guide data.

In this example, when the license condition indicates that “the numberof playback times is less than 4”, the sample frames M1 through M8 areplayed back, and the audio guide frames G1 and G2 are also played back.When the license condition indicates that “the number of playback timesis more than 3”, that is, when the number of playback times is 4 ormore, only the audio guide frames G3 and G4 are played back withoutplaying back the sample frames. That is, for up to three playback times,all the sample frames are played back subsequent to the audio guidance“sample data can be played back”, and when the number of playback timesexceeds three, only the audio guidance “sample data cannot be playedback” is played back. This enables the user to recognize that the sampledata 71 is no longer valid.

The position at which the audio guide data is inserted into the sampledata 71 and the number of items of guide data are not restricted. Forexample, if it is desired that the audio guide data be issued beforeplaying back the sample frames, it is inserted at a position before thehead of the frames (the left side in FIG. 14). If it is desired that theaudio guide data be issued after playing back the sample frames, it isinserted at a position after the final sample frame (the right side inFIG. 14).

The audio guide frames can be coded by the same coding method as thatused for the sample frames, in which case, it can be decoded accordingto processing similar to that for the sample frames. It is thus possibleto simplify the configurations of the coding device 2 and the dataplayback device 5.

The additional data 72 shown in FIG. 14 includes a header containing thecontent ID (CID), additional frames S1 through S8, usage-licenseinformation L2, and audio guide frames G1′ and G2′. The additionalframes S1 through S8 contain data required for reconstructing the codedframes of the original data from the sample frames M1 through M8 of thesample data 71.

The audio guide frames G1′ and G2′ are audio guide data to be insertedinto high-quality data 73, and are generated by coding the speech “thetitle is XX”.

The usage license information L2 of the additional data 72 includes atleast one license condition (in this example, an unlimited condition)for the high-quality data 73, a zone (high-quality frame zone) for codedframes whose quality must be increased from the sample data 71, a zone(erase frame zone) of coded frames to be erased from the sample data 71,and a zone (add frame zone) for coded frames to be added to thehigh-quality data 73.

That is, the license conditions, the zone of the content frames, and thezone of the audio guide frames indicated in the usage-licenseinformation L1 of the sample data 71 are changed to those indicated inthe usage-license information L2 of the additional data 72. The codedframes in the erase frame zone indicated in the usage-licenseinformation L2 are erased from the sample data 71, and the coded framesin the add frame zone indicated in the usage-license information L2 areinserted into the high-quality data 73 from the additional frame 72.

Information M1 through M8 in the sample data 71 are used for associatingthe additional frames S1 through S8 contained in the additional frame 72with the sample frames M1 through M8, and also contain the positions ofthe sample frames M1 through M8 in the sample data 71 if necessary.

If the additional frames contained in the additional data 72 areassociated with only part of the sample frames M1 through M8 of thesample data 71, the high-quality frame zone indicates the correspondingsample frames. For example, if only the additional frames S1 through S4are contained in the additional data 72, the high-quality frame zoneindicated in the usage-license information L2 should be M1 through M4,and the quality of the sample frames M5 through M8 is not increased.Accordingly, as long as the high-quality frame zone indicated in theusage-license information L2 of the additional data 72 is consistentwith the additional frames contained in the additional data 72, thehigh-quality frame zone and the number of frames can be set as desired.

Information concerning the erase frame zone indicating the frames to beerased from the sample data 71 contains information concerning thepositions thereof if necessary, and indicates coded frames of thecontent data or the audio guide data that should be erased whenincreasing the quality of the sample data 71. The erase frame zone andthe number of frames can be set as desired.

Information concerning the add frame zone indicating the frames to beadded to the sample data 71 contains information concerning thepositions thereof if necessary, and indicates coded frames of thecontent data or the audio guide data that should be added to thehigh-quality data 73 when increasing the quality of the sample data 71.As long as coded frames of the content data or the audio guide data tobe added are contained in the additional data 72, the add frame zone andthe number of frames can be set as desired.

The high-quality data 73 shown in FIG. 14 is data to be reconstructed byusing the above-described sample data 71 and additional data 72. Thehigh-quality data 73 includes a header containing the content ID (CID),high-quality coded frames C1 through C8, usage-license information L3,and audio guide frames G1′ and G2′. The coded frames C1 through C8 aregenerated by using the sample frames M1 through M8 and the additionalframes S1 through S8.

The usage-license information L3 of the high-quality data 73 indicatespart of the data contained in the usage-license information L2 of theadditional data 72, i.e., at least one license condition and the zone ofcoded frames that can be played back under each condition. In theexample shown in FIG. 14, the zone of coded frames is indicated for boththe content data and the audio guide data.

The audio guide frames G1′ and G2′ are originally contained in theadditional data 72, and are coded frames that are inserted whenincreasing the quality of the sample data 71. In this example, the audioguide frames G1′ and G2′ are generated by coding the speech “the titleis XX”. That is, based on the usage-license information L2 of theadditional data 72, the audio guide frames G1 through G4 of the sampledata 71 are erased, and the audio guide frames G1′ and G2′ contained inthe additional data 72 are inserted.

In this example, the license conditions are updated so that thehigh-quality coded frames C1 through C8 can be played back withoutlimit, and so that the audio guide frames G1′ and G2′ can also be playedback. That is, when playing back the high-quality data 73, the highquality coded frames C1 through C8 are played back subsequent to theaudio guidance, i.e., “the title is XX”. The audio guide frames G1′ andG2′ do not have to be contained in the additional data 72, in whichcase, audio guide data is excluded from the high-quality data 73.Alternatively, a function for designating whether audio guide data isplayed back may be provided for the data playback device 5 that playsback the sample data 71 or the high-quality data 73, in which case, itis possible to select whether the audio guide data is played back.

In FIG. 14, the license-condition is the number of playback times.Alternatively, the playback expiry date, the playback period, or theplayback time may be set to be the license condition. If the licensecondition-contains the playback expiry date, it may be determinedwhether the condition is satisfied by using a calendar function. If thelicense condition contains the playback period, it may be determinedwhether the condition is satisfied by using a calendar function or atimer function. If the license condition contains the accumulated valueof the playback time, it can be determined whether the condition issatisfied by using a timer function and a memory function. If thelicense condition contains the number of playback times, it can bedetermined whether the condition is satisfied by using a counterfunction and a memory function. The type of license condition is not alimitation to implement the present invention.

The audio guide data is not restricted to the playback status of thesample data 71 or the high-quality data 73. Instead, advertisements ofcontent, creator's messages, descriptions of the place and the methodfor obtaining the additional data 72, the license conditions and themethod for using the sample data 71 or the high-quality data 73, etc.may be output as the audio guide data. Common audio guide data may beused for all the items of content. Alternatively, the audio guide datamay be set for each item of content, in which case, advertisements andsales promotion of the content can be effectively achieved.

Sample-data generation processing is described below with reference tothe flowchart of FIGS. 15 and 16.

In step S1, the controller 61 of the data separator 14 obtains settingvalues for a permitted sample zone input from an operation input unit(not shown). As described with reference to FIGS. 11 and 12, it isassumed that the quantizing units [1] through [12] are specified as thesample band, the sample start position is the head of the content, andthe sample zone length is the entire content. That is, the bands of allthe coded frames are restricted by the quantizing units [1] through[12]. The controller 61 supplies the setting values of the sample zoneto the band-restriction processor 63.

In step S2, the band-restriction processor 63 sequentially receivesframes contained in the original data, that is, frames that can beplayed back with high audio quality described with reference to FIG. 9.

In step S3, it is determined based on the setting values obtained instep S1 whether an input coded frame is contained in the sample zone,and if so, the band-restriction processor 63 replaces the normalizingcoefficients of the tone components outside the sample band by, forexample, a dummy value of 0. Accordingly, the spectrum coefficients ofthe tone components outside the sample band can be minimized when thecoded frame is played back. In contrast, if the input coded frame is notcontained in the sample zone, the band-restriction processor 63 replacesthe normalizing coefficients of all the tone components by, for example,a dummy value of 0. Then, the spectrum coefficients of all the tonecomponents are minimized when the coded frame is played back.

Also in step S3, the band-restriction processor 63 supplies the truevalues of the normalizing coefficients of the tone components replacedby the dummy value to the additional-frame generator 65 so that they canbe contained in the additional data in step S6, which is describedbelow.

In step S4, if it is determined that the input coded frame is containedin the sample zone, the band-restriction processor 63 replaces thenormalizing coefficients of the non-tone components outside the sampleband by, for example, a dummy value of 0. Accordingly, the spectrumcoefficients of the non-tone components outside the sample band areminimized when the coded frame is played back. Conversely, if the inputcoded frame is not contained in the sample zone, the band-restrictionprocessor 63 replaces the normalizing coefficients of all the non-tonecomponents by, for example, a dummy value of 0. Then, the spectrumcoefficients of all the non-tone components are minimized when the codedframe is played back.

Also in step S4, the band-restriction processor 63 supplies the truevalues of the normalizing coefficients of the non-tone componentsreplaced by the dummy value to the additional-frame generator 65 so thatthey can be contained in the additional data in step S6, which isdescribed below.

In step S5, if the input coded frame is contained in the sample zone,the spectrum-coefficient information overwriter 64 replaces part of thespectrum-coefficient information of the non-tone components in bandshigher than the sample band by dummy values that prevent the true valuesfrom being predicted. In contrast, if the input coded frame is notcontained in the sample zone, the spectrum-coefficient informationoverwriter 64 replaces part of the spectrum-coefficient information ofcertain non-tone components by dummy values that prevent the true valuesfrom being predicted. Then, the spectrum-coefficient informationoverwriter 64 supplies the true values to the additional-frame generator65 so that they can be contained in the additional frame in step S6.

In step S6, the additional-frame generator 65 records in the additionalframe, as shown in FIG. 13, the normalizing-coefficient information ofthe tone components and the normalizing-coefficient information of thenon-tone components supplied from the band-restriction processor 63, andthe spectrum-coefficient information of the non-tone components suppliedfrom the spectrum-coefficient information overwriter 64, therebygenerating additional data.

After step S6, the controller 61 determines in step S7 whether theprocessed frame is the final frame. If the outcome of step S7 is no, theprocess returns to step S2, and step S2 and the subsequent steps arerepeated.

If it is found in step S7 that the processed frame is the final frame,the process proceeds to step S8. In step S8, the sample-data generator66 generates the header of the sample data, adds the header to eachsample frame, and supplies the sample data to the usage-licenseinformation adder 68.

In step S9, the additional-data generator 67 generates the header of theadditional data, adds the header to each additional frame, and suppliesthe additional data to the usage-license information adder 68.

In step S10, the controller 61 obtains setting values for usage licenseinformation and audio guide data input from an operation input unit (notshown). The controller 61 then supplies the setting values for the usagelicense information to the usage-license information adder 68.

In step S11, the usage-license information adder 68 adds the usagelicense information and the audio guide data to the sample data suppliedfrom the sample-data generator 66, as described with reference to FIG.14, based on the setting values of the usage license informationsupplied from the controller 61.

More specifically, if the number of playback times of the sample data ispermitted up to three, the license condition is set to be “the number ofplayback times is less than four.”. Then, the zone of coded frames thatcan be played back under the license condition is set to be M1 throughMB, and the zone of audio guide frames that can be played back under thelicense condition is set to be G1 and G2. Also, the condition forprohibiting the playback operation of the content is set to be “thenumber of playback times is more than three”, and the zone of audioguide frames that are played back under this license condition is G3 andG4.

In step S12, the usage-license information adder 68 adds the usagelicense information and the audio guide data to the additional datasupplied from the additional-data generator 67, as described withreference to FIG. 14, based on the setting values for the usage licenseinformation supplied from the controller 61. The sample-data generationprocessing is then completed.

If the playback operation of the high-quality content data is notrestricted, the license condition is set to be “unlimited”, and the zoneof high-quality coded frames that can be played back under this licensecondition is set to be C1 through. C8, and the zone of audio guideframes that can be played back under this license condition is set to beG1′ and G2′.

According to the processing indicated by the flowchart of FIGS. 15 and16, sample data that can be played back with low quality accompanied byaudio guide data based on the designated license condition, andadditional data to be obtained by a user who has previewed or listenedto the sample data when increasing the quality of the sample data can begenerated.

The sample data generated as described above is distributed to users viathe Internet or is recorded in various recording media possessed byusers by using a MK installed in a store. If a user likes the contentafter previewing or listening to the sample data, the user is able toobtain the additional data by paying a predetermined amount of money tothe distributor of the content data. The user is able to reconstruct theoriginal data by increasing the quality of the sample data by using theobtained additional data, and also, updates the usage licenseinformation so as to decode and play back the high-quality data or torecord it in a recording medium.

A description is now given of processing when sample data is decoded andis output or played back, or when original data is reconstructed fromsample data and additional data and is output or played back.

FIG. 17 is a block diagram illustrating the configuration of the dataplayback device 5.

A code-string decomposer 91 receives coded frames of sample data anddecomposes a code string to extract the codes of the signal components,and outputs them to a code-string reconstructor 93. If usage licenseinformation is contained in the decomposed code string, the code-stringdecomposer 91 outputs the usage license information to a controller 92.

Upon receiving information input from a user through an operation inputunit (not shown), the controller 92 determines whether the data inputinto the code-string decomposer 91 is played back with high quality orlow quality, and controls an additional-data input unit 96, thecode-string reconstructor 93, and a usage-license information manager97.

The controller 92 outputs the usage license information supplied fromthe code-string decomposer 91 to the usage-license information manager97, and stores it therein. When the sample data is played back, thecontroller 92 refers to the usage license information stored in theusage-license information manager 97, and determines whether the sampledata can be played back. If the playback operation of the sample data ispermitted; the controller 92 controls the code-string reconstructor 93to supply coded frames and audio guide frames of the sample datasupplied from the code-string decomposer 91 to a signal componentdecoder 94.

The usage-license information manager 97 stores, changes, or updates thesupplied usage license information under the control of the controller92.

Upon receiving additional data, if the additional data is encrypted, theadditional data input unit 96 decrypts the encrypted additional data,identifies usage license information, audio guide data, and additionalframes, and supplies them to the controller 92.

When a high-quality operation is performed, the controller 92 controlsthe additional-data input unit 96 to obtain the additional data. Thecontroller 92 also controls the usage-license information manager 97 toupdate the stored usage license information based on the usage licenseinformation of the additional data, and controls the code-stringreconstructor 93 to increase the quality of the sample frames, and eraseand insert the audio guide frames based on the usage license informationof the additional data.

That is, when the high-quality operation is performed, the code-stringreconstructor 93 reconstructs high-quality coded frames from the sampleframes supplied from the code-string decomposer 91 by using theadditional frames supplied from the controller 92, and supplies thereconstructed coded frames to the signal component decoder 94. Thecode-string reconstructor 93 then transfers coded frames indicated inthe add frame zone supplied from the controller 92 to the signalcomponent decoder 94, and erases coded frames indicated in the eraseframe zone supplied from the code-string decomposer 91 under the controlof the controller 92.

If the use of the content is restricted by the number of playback timesor the playback time, the controller 92 controls the usage-licenseinformation manager 97 to update the usage license information bycounting the current number of playback times with a counter or bycounting the accumulated value of the current playback time with atimer.

The signal component decoder 94 decodes the input sample data or thehigh-quality coded frames. FIG. 18 is a block diagram illustrating thedetailed configuration of the signal component decoder 94 for decodinginput coded frames into tone components and non-tone components when thecoded frames are coded by being separated into tone components andnon-tone components.

A frame separator 101 receives a coded frame, such as that shown in FIG.9 or 11, and separates it into tone components and non-tone components.The tone components are output to a tone-component decoder 102, and thenon-tone components are output to a non-tone-component decoder 103.

FIG. 19 is a block diagram illustrating the detailed configuration ofthe tone-component decoder 102. A dequantizer 111 dequantizes inputcoded data and outputs the dequantized data to an inverse normalizer112. The inverse normalizer 112 inverse-normalizes the input data. Thatis, decoding processing is performed by the dequantizer 111 and theinverse normalizer 112 so as to output a spectrum signal of the tonecomponents.

FIG. 20 is a block diagram illustrating the detailed configuration ofthe non-tone-component decoder 103. A dequantizer 121 dequantizes inputcoded data and outputs the dequantized data to an inverse normalizer122. The inverse normalizer 122 inverse-normalizes the input data. Thatis, decoding processing is performed by the dequantizer 121 and theinverse normalizer 122 so as to output a spectrum signal of the non-tonecomponents.

A spectrum-signal synthesizer 104 receives the spectrum signalcomponents output from the tone-component decoder 102 and the non-tonecomponent decoder 103, and combines the spectrum signal components. Thespectrum-signal synthesizer 104 generates the spectrum signal shown inFIG. 6 for high-quality data, or generates the spectrum signal shown inFIG. 12 for sample data, and then outputs the spectrum signal to aninverse transformer 95.

If the coded data is coded without being divided into tone componentsand non-tone components, the frame separator 101 can be omitted, anddecoding processing is performed by using one of the tone-componentdecoder 102 and the non-tone-component decoder 103.

FIG. 21 is a block diagram illustrating the detailed configuration ofthe inverse transformer 95.

A signal separator 131 separates a signal based on the number of dividedbands indicated in the header of an input coded frame. In this case, thenumber of divided bands is two, and the signal separator 131 separatesthe input spectrum signal into two bands, and outputs them toinverse-spectrum transformers 132-1 and 132-2.

The inverse-spectrum transformers 132-1 and 132-2 performinverse-spectrum transform on the input spectrum signal components, andoutputs the transformed signal components in the corresponding bands toa band-synthesizing filter 133. The band-synthesizing filter 133combines the input signal components, and outputs the resultingsynthesized signal.

The signal (for example, an audio PCM signal) output from theband-synthesizing filter 133 is converted into analog data by adigital-to-analog (D/A) converter not shown), and may be output from aspeaker (not shown) as sound. The signal output from theband-synthesizing filter 133 may be output to another device via anetwork.

Sample-data playback processing performed by the data playback device 5shown in FIG. 17 is described below with reference to the flowchart ofFIG. 22.

In step S21, the controller 92 obtains usage license information of thesample data from the usage-license information manager 97, and alsoidentifies the current usage status, for example, the number of playbacktimes or the playback time, of the sample data.

In step S22, the controller 92 determines whether audio guide data is tobe played back according to an operation input from the user through thedata playback device 5. If the outcome of step S22 is yes, the processproceeds to step S23 in which the controller 92 identifies audio guideframes in the sample data to be played back based on the usage licenseinformation and the current usage status. The process then proceeds tostep S24.

For example, if the number of playback times upon receiving the sampledata 71 shown in FIG. 14 is less than 4, the controller 92 identifiesthe audio guide frames G1 and G2 as the coded frames to be played back.If the number of playback times is 4 or more, the controller 92identifies the audio guide frames G3 and G4 as the coded frames to beplayed back. If it is found in step S22 that audio guide data is notplayed back, the process proceeds to step S24.

In step S24, the controller 92 identifies sample frames in the sampledata to be played back based on the usage license information and thecurrent usage status of the sample data obtained in step 521. Forexample, if the number of playback times upon receiving the sample data71 shown in FIG. 14 is less than 4, the controller 92 identifies thesample frames M1 through M8 as the coded frames to be played back. Ifthe number of playback times is 4 or more, the controller 92 determinesthat there is no sample frame to be played back.

In step S25, the code-string decomposer 91 receives coded frames of thesample data. In step S26, under the control of the controller 92, thecode-string decomposer 91 decomposes coded frames that can be playedback under the condition indicated in the usage license information, andoutputs the decomposed coded frames to the code-string reconstructor 93.If the number of playback times upon receiving the sample data 71 shownin FIG. 14 is less than 4, the audio guide frames G1 and G2 and thesample frames M1 through M8 are decomposed and are sequentially suppliedto the code-string reconstructor 93. If the number of playback times is4 or more, the audio guide frames G3 and G4 are decomposed and aresequentially supplied to the code-string reconstructor 93.

The code-string reconstructor 93 then transfers the decomposed codestring to the signal component decoder 94 under the control of thecontroller 92. In step S27, the signal component decoder 94 divides theinput code string into tone components and non-tone components, anddecodes them by dequantizing and inverse-transforming them so as togenerate spectrum signal components. The signal component decoder 94then combines the generated spectrum signal components and outputs thesynthesized spectrum signal to the inverse transformer 95.

In step S28, the inverse transformer 95 separates the input spectrumsignal into bands if necessary, and inverse-spectrum transforms theseparated signal components. The transformed signal components are thencombined, and the combined signal is inverse-transformed into atime-series signal.

After step S28, the controller 92 determines in step S29 whether thereis a coded frame to be played back among the audio guide framesidentified in step S23 or the sample frames identified in step S24.

If it is found in step S29 that there is a coded frame to be playedback, the process returns to step S25, and step S25 and the subsequentsteps are repeated. If it is found in step S29 that there is no codedframe to be played back, the process proceeds to step S30.

In step S30, the usage-license information manager 97 updates the numberof playback times or the playback time as the usage status of the sampledata, and the sample-data playback processing is completed.

High-quality playback processing performed by the data playback device 5shown in FIG. 17 is now described with reference to the flowchart ofFIGS. 23 and 24.

In step S41, under the control of the controller 92, upon receivingadditional data, if the additional data is encrypted, theadditional-data input unit 96 decrypts the additional data, identifiesusage license information, audio guide data, and additional frames, andsupplies them to the controller 92.

In step S42, the controller 92 obtains the usage license information andthe audio guide data supplied from the additional-data input unit 96,and also updates the usage license information stored in theusage-license information manager 97 based on the information containedin the additional data so as to identify the current, usage status, suchas the number of playback times or the playback time, of thehigh-quality data.

In step S43, the controller 92 determines whether the audio guide datais to be played back according to an operation input from the userthrough the data playback device 5. If the outcome of step S43 is yes,the process proceeds to step S44. In step S44, the controller 92identifies audio guide frames to be played back based on the usagelicense information and the current usage status, and proceeds to stepS45. If the additional data 72 shown in FIG. 14 is received, thecontroller 92 identifies the audio guide frames G1′ and G2′ contained inthe additional data as the coded frames to be played back rather thanthe audio guide frames G1 through G4 contained in the sample data. If itis determined in step S43 that the audio guide data is not played back,the process proceeds to step S45.

In step S45′ the controller 92 identifies sample frames in the sampledata whose quality is to be increased based on the usage licenseinformation and the current usage status of the additional data obtainedin step S42. If the additional data 72 shown in FIG. 14 is received, thecontroller 92 identifies the sample frames M1 through M8 as the codedframes whose quality is to be increased.

In step S46, the code-string decomposer 91 receives the coded frames ofthe sample data. Then, in step S47, the code-string decomposer 91decomposes the input code string and outputs the decomposed code stringto the code-string reconstructor 93. If the sample data 71 shown in FIG.14 is received, the sample frames M1 through M8 are sequentiallysupplied to the code-string reconstructor 93.

In step S48, the code-string reconstructor 93 determines whether thecode string supplied from the code-string decomposer 91 is audio guidedata. If the outcome of step S48 is yes, the process proceeds to stepS50. If the controller 92 supplies the audio guide frames contained inthe additional data to the code-string reconstructor 93 based on theusage license information of the additional data, it is also determinedin step S48 that the supplied code string is audio guide data.Accordingly, the process proceeds to step S50.

In contrast, if it is determined in step S48 that the code stringsupplied to the code-string reconstructor 93 is not audio guide frames,that is, if it is determined that the code string indicates sampleframes, the controller 92 supplies the additional frames associated withthe sample frames to the code-string reconstructor 93. The code-stringreconstructor 93 then performs code-string reconstruction processing instep S49, which is described below, indicated by the flowchart of FIG.25, so as to reconstruct the coded frames of the original data from thesample frames by using the additional frames supplied from thecontroller 92. In the example shown in FIG. 14, the sample frames M1through M8 are sequentially supplied to the code-string reconstructor 93from the code-string decomposer 91, and simultaneously, the additionalframes S1 through S8 are sequentially supplied to the code-stringreconstructor 93 from the controller 92.

In step S50, the signal component decoder 94 divides the input codestring into tone components and non-tone components, and decodes them bydequantizing and inverse-transforming them so as to generate spectrumsignal components. The signal component decoder 94 then combines thegenerated spectrum signal components and outputs the synthesizedspectrum signal to the inverse transformer 95.

In step S51, the inverse transformer 95 separates the input spectrumsignal into bands if necessary, and inverse-spectrum transforms theseparated signal components. The transformed signal components are thencombined, and the combined signal is inverse-transformed into atime-series signal.

After step S51, the controller 92 determines in step S52 whether thereis a coded frame to be played back among the audio guide framesidentified in step S44 or the sample frames whose quality is to beincreased identified in step S45.

If it is determined in step S52 that there is a coded frame to be playedback, the process returns to step S46, and step S46 and the subsequentsteps are repeated. If it is found in step S52 that there is no codedframe to be played back, the process proceeds to step S53.

In step S53, the usage-license information manager 97 updates the usagelicense information of the sample data based on the usage licenseinformation of the additional data obtained in step S42, and also,updates the usage status, such as the number of playback times or theplayback time, of the high-quality data if necessary. The high-qualityplayback processing is then completed.

The time-series signal generated by being inverse-transformed by theinverse transformer 95 is converted into analog data by a D/A converter(not shown), and may be output from a speaker (not shown).Alternatively, the signal may be output to another device via a network(not shown).

In this example, it is assumed that the sample data is coded by beingseparated into tone components and non-tone components. However, if thesample data is not separated into tone components and non-tonecomponents, reconstruction processing and playback processing similar tothose described above can also be performed.

Details of the code-string reconstruction processing performed in stepS49 of FIG. 24 are described below with reference to the flowchart ofFIG. 25.

In step S61, the code-string reconstructor 93 receives sample framessupplied from the code-string decomposer 91. Then, in step S62, thecontroller 92 supplies additional frames associated with the sampleframes to the code-string reconstructor 93.

In step-S63, the code-string reconstructor 93 reconstructs thenormalizing-coefficient information of the tone components of the inputsample frames based on the normalizing-coefficient information of thetone components indicated in the input additional frames.

In step S64, the code-string reconstructor 93 reconstructs thenormalizing-coefficient information of the non-tone components of theinput sample frames based on the normalizing-coefficient information ofthe non-tone components indicated in the input additional frames.

In step S65, the code-string reconstructor 93 reconstructs part of thespectrum-coefficient information of the non-tone components of the inputsample frames based on the spectrum-coefficient information of thenon-tone components indicated in the input additional frames.

After step S65, the code-string reconstructor 93 completes thecode-string reconstruction processing, and if the high-quality playbackoperation is performed, the process returns to step S50 of FIG. 24, andif the high-quality recording operation is performed, the processreturns to step S93 of FIG. 28.

According to the processing indicated by the flowchart of FIG. 25,high-quality coded frames can be reconstructed by using sample framesand additional frames.

The decoded sample data or the reconstructed and decoded original databy the processing shown in FIGS. 17 through 25 may be output via aspeaker (not shown), or may be output to another device via, forexample, a network.

A description is now given of processing for recording sample data in arecording medium or for reconstructing original data from sample dataand additional data and recording the reconstructed original data in arecording medium.

FIG. 26 is a block diagram illustrating the configuration of the datarecording device 6.

In FIG. 26, elements corresponding to those of the data playback device5 shown in FIG. 17 are indicated by like reference numerals, and anexplanation thereof is thus omitted.

A code-string decomposer 91 receives sample frames and decomposes a codestring so as to extract signal components. A controller 92 receives anoperation from a user through an operation input unit (not shown) anddetermines whether the input sample data is to be recorded with highquality, i.e., whether the original data is to be reconstructed andrecorded. The controller 92 then controls an additional-data input unit96 to receive additional data, and supplies the additional frames to thecode-string reconstructor 93.

When recording the input sample data, the code-string reconstructor 93directly outputs the input sample frames to a recorder 151 under thecontrol of the controller 92. When reconstructing and recording theoriginal data, the code-string reconstructor 93 reconstructs, under thecontrol of the controller 92, the coded frames of the original data fromthe input sample data by using the additional frames supplied from thecontroller 92, and outputs the reconstructed coded frames of theoriginal data to the recorder 151.

When high-quality recording is performed, the code-string reconstructor93 does not output the sample frames indicated in the erase frame zoneof the additional frames to the recorder 151 based on the usage licenseinformation of the additional data. If coded frames indicated in the addframe zone, such as audio guide frames contained in the additional data,are supplied from the controller 92, the code-string reconstructor 93outputs such coded frames to the recorder 151.

The recorder 151 records the data in a recording medium, for example, amagnetic disk, an optical disc, a magneto-optical disk, a semiconductormemory, or magnetic tape, according to a predetermined method. Therecorder 151 may be a storage unit, such as a memory or a hard disk,provided for A substrate. For example, if the recorder 151 is able torecord data in an optical disc, the recorder 151 is formed of an encoderfor converting data into a format that is suitable for being recorded inan optical disc, an optical unit including a laser light source, such asa laser diode, various lenses, and a deflection beam splitter, a spindlemotor for driving an optical disc, a driver for driving the optical unitto a predetermined track position of an optical disc, and a controllerfor controlling all the elements.

A recording medium loaded in the recorder 151 may be the same as therecording medium in which the sample data input into the code-stringdecomposer 91 or the additional data input into the controller 92 isrecorded.

Data recording processing performed by the data recording device 6 isdescribed below with reference to the flowchart of FIGS. 27 and 28.

In step S81, the controller 92 obtains usage license information ofsample data input into the data recording device 6.

In step S82, the controller 92 determines whether high-quality recordingis performed. If the outcome of step S82 is no, the process proceeds tostep S86. If it is determined in step S82 that high-quality recording isperformed, the process proceeds to step S83.

In step S83, under the control of the controller 92, upon receivingadditional data, if the additional data is encrypted, theadditional-data input unit 96 decrypts the additional data, identifiesusage license information, audio guide data, and additional frames, andsupplies them to the controller 92.

In step S84, the controller 92 obtains the usage license information andthe audio guide data from the additional-data input unit 96.

In step S85, the controller 92 identifies sample frames of the sampledata whose quality should be increased based on the usage licenseinformation of the additional data obtained in step S84. In the exampleshown in FIG. 14, the sample frames M1 through M8 are identified as thecoded frames whose quality should be increased.

In step S86, the controller 92 identifies audio guide frames to berecorded. That is, if high-quality recording is not performed, thecontroller 92 identifies audio guide frames to be recorded based on theusage license information of the sample data. In the example shown inFIG. 14, the audio guide frames G1 through G4 are identified as thecoded frames to be recorded. If high-quality recording is performed, thecontroller 92 identifies audio guide frames to be recorded based on theusage license information of the additional data. In the example shownin FIG. 14, the audio guide frames G1 and G2′ are identified as thecoded frames to be recorded.

In step S87, the controller 92 identifies sample frames to be recorded.If high-quality recording is not performed, the controller 92 identifiessample frames to be recorded based on the usage license information ofthe sample data. In the example shown in FIG. 14, the sample frames M1through M8 are identified as the coded frames to be recorded. Ifhigh-quality recording is performed, the controller 92 identifies sampleframes to be recorded by increasing the quality based on the usagelicense information of the additional data. In the example shown in FIG.14, the sample frames M1 through M8 are identified as the coded framesto be recorded by increasing the quality.

In step S88, the code-string decomposer 91 receives coded frames of thesample data. Then, in step S89, the code-string decomposer 91 decomposesan input code string and outputs the decomposed codes to the code-stringreconstructor 93. In the example shown in FIG. 14, if high-qualityrecording is not performed, the audio guide frames G1 and G2, the sampleframes M1 through M8, and the audio guide frames G3 and G4 aresequentially input. If high-quality recording is performed, the audioguide frames G1′ and G2′ and the sample frames M1 through M8 aresequentially input.

In step S90, the code-string reconstructor 93 determines whether thecode string supplied from the code-string decomposer 91 indicates audioguide frames. If the outcome of step S90 is yes, the process proceeds tostep S93. If the controller 92 supplies the audio guide frames containedin the additional data to the code-string reconstructor 93 based on theusage license information of the additional data, the outcome of stepS90 also becomes yes, and the process-proceeds to step S93.

Conversely, if it is determined in step S90 that the code stringsupplied to the code-string reconstructor 93 does not indicate audioguide frames, that is, if it is, determined that the code stringindicates sample frames, the process proceeds to step S91. In step S91,the controller 92 determines whether high-quality recording isperformed. If the result of step S91 is no, the process proceeds to stepS93. If the result of step S91 is yes, additional frames associated withthe sample frames are supplied to the code-string reconstructor 93.

In step S92, the code-string reconstructor 93 performs the code-stringreconstruction processing described with reference to the flowchart ofFIG. 25 so as to reconstruct coded frames of the original data from thesample frames by using the additional frames supplied from thecontroller 92. In the example shown in FIG. 14, the sample frames M1through M8 are sequentially supplied to the code-string reconstructor 93from the code-string decomposer 91, and simultaneously, the additionalframes S1 through S8 are sequentially supplied to the code-stringreconstructor 93 from the controller 92.

If it is found in step S90 that the coded frames input into thecode-string reconstructor 93 are audio guide frames, or if it is foundin step S91 that high-quality recording is not performed, or after thecode-string reconstruction processing in step S92, the process proceedsto step S93 in which the recorder 151 records the input code string intoa recording medium loaded in the data recording device 6. In the exampleshown in FIG. 14, if high-quality recording is not performed, the audioguide frames G1 and G2, the sample frames M1 through M8, and the audioguide frames G3 and G4 are sequentially recorded. If high-qualityrecording is performed, the audio guide frames G1′ and G2′ and thehigh-quality coded frames C1 through C8 are sequentially recorded.

After step S93, the controller 92 determines in step S94 whether thereis a coded frame to be recorded among the audio guide frames identifiedin step S86 or among the sample frames identified in step S87.

If it is determined in step S94 that there is a coded frame to berecorded, the process returns to step S88, and step S88 and thesubsequent steps are repeated. If it is found in step S94 that there isno coded frame to be recorded, the process proceeds to step S95.

In step S95, if high-quality recording is not performed, theusage-license information manager 97 records the usage licenseinformation of the sample data obtained in step S81. If high-qualityrecording is performed, the usage-license information manager 97 updatesand records the usage license information of the sample data obtained instep S81 based on the usage license information of the additional dataobtained in step S84. High-quality recording-processing is thencompleted. In the example shown in FIG. 14, if high-quality recording isnot performed, the usage license information L1 is recorded, and ifhigh-quality recording is performed, the usage license information L3 isrecorded.

One important feature of the present invention is to add information inunits of coded frames for playing back content data, and coded frames tobe played back can be switched based on various conditions, such as thenumber of usages and the usage expiry date. For example, a plurality ofitems of audio guide data are inserted into content data as the codedframes, and are played back by being switched before and after the usageexpiry date. This enables a user to know whether the content data can beplayed back.

Another important feature of the present invention is to erase part ofcoded frames from coded content data, or to add other coded frames. Forexample, when purchasing original data of the content, advertising audiodata inserted into sample data can be erased, or commenting audio datacan be added.

When distributing digital content, a content provider generates sampledata in which part of original data is replaced by dummy data, and asmall-amount additional data containing the true values of the dummydata, and adds usage license information and audio guide data to thesample data and the additional data. It is thus possible to achieveeffective sales promotion while protecting the copyright. A content useris able to check in sound whether obtained sample data can be used orhow to purchase the data. This is very convenient, and the user does notconsider that the playback device has broken down even if the contentdata cannot be played back.

Additional data formed of additional frames containing true values (forexample, true normalizing-coefficient information or truespectrum-coefficient information) of data replaced by dummy data whenthe sample data is generated is generated, thereby making it possible toreconstruct the original data from the sample data by using theadditional data. The usage license information of the sample data can beupdated based on the usage license information contained in theadditional data.

By applying the present invention, sample data and reconstructedoriginal data can be played back and output, or can be recorded in arecording medium, or output to another device via, for example, anetwork.

In the above-described embodiment, sample data and correspondingadditional data are generated from audio-signal content data, andaudio-signal original data is reconstructed from sample data andadditional data; and is played back or recorded. In the presentinvention, content data may include image signals or image signals andaudio signals.

The above-described series of processing may be executed by hardware orsoftware. If software is used, the coding device 2, the data playbackdevice 5, or the data recording device 6 may be formed of a personalcomputer 161 shown in FIG. 29.

In FIG. 29, a central processing unit (CPU) 171 executes various typesof processing according to a program stored in a read only memory (ROM)172 or a program loaded into a random access memory (RAM) 173. The RAM173 also stores data required for executing various types of processingby the CPU 171.

The CPU 171, the ROM 172, and the RAM 173 are connected to each othervia a bus 174. An input/output interface 175 is also connected to thebus 174.

The input/output interface 175 is also connected to an input unit 176including, for example, a keyboard and a mouse, an output unit 177including, for example, a display device and a speaker, a storage unit178 formed of, for example, a hard disk, and a communication unit 179including, for example, a modem and a terminal adapter. Thecommunication unit 179 performs communication processing via a networkincluding the Internet.

The input/output interface 175 is also connected to a drive 180. Arecording medium, such as a magnetic disk 191, an optical disc 192, amagneto-optical disk 193, or a semiconductor memory 194, is loaded inthe drive 180, and a computer program read from such a recording mediumis installed into the storage unit 178.

If the above-described series of processing is executed by software, thesoftware programs is installed via a network or a recording medium intoa computer integrated in dedicated hardware, or into a computer, forexample, a general-purpose personal computer, that is able to executevarious functions by installing various programs.

Such a recording medium includes package media, such as the magneticdisk 191 (including floppy disks), the optical disc 192 (includingcompact disc read only memory (CD-ROM) and digital versatile disk(DVD)), the magneto-optical disk 193 (including mini disk (MD)™), andthe semiconductor memory 194, which are distributed for supplying theprograms to users. The recording-medium also includes the ROM 172 and ahard disk contained in the storage unit 178 storing the programstherein, which are supplied to users while being integrated into thedevice.

In this specification, steps forming the programs stored in a recordingmedium include not only processing executed in chronological order, butalso processing executed concurrently or individually.

1-19. (canceled)
 20. A data processing method for playing back or forrecording a first data string comprising a second data string, themethod comprising: reading managing usage license information, themanaging usage license information including information indicating atleast one condition for permitting at least a part of the first datastring to be played back or to be recorded and information indicatingthe part of the first data string which is permitted to be played backor to be recorded based on the at least one condition; decomposing, intofrequency components, the part of the first data string to be playedback or to be recorded and a second data string, the second data stringincluding data comprising spectrum coefficient information of thefrequency components; and transforming the frequency components into adata signal for playing back or for recording the part of the first datastring which is permitted, based on the usage license information, to beplayed back or to be recorded. 21-25. (canceled)
 26. A data processingmethod according to claim 20, wherein the usage license information isencrypted.
 27. A data processing method according to claim 20, whereinthe at least one condition includes at least one of informationindicating the number of usages of the first data string, informationindicating an expiry date of the first data string, informationindicating a period for which the first data string is used, andinformation indicating a time for which the first data string is used.28-29. (canceled)
 30. A data processing method according to claim 20,wherein the frequency components include at least one ofnormalizing-coefficient information and quantizing-precisioninformation.
 31. (canceled)
 32. A data processing method according toclaim 20, wherein a part of the data of the second data string comprisesrandom data.
 33. A data processing method according to claim 20, whereinthe first data string includes audio data.
 34. A data processing methodaccording to claim 20, wherein the second data string includes audiodata. 35-36. (canceled)
 37. A data processing apparatus for playing backor for recording a first data string comprising a second data string,the data processing apparatus comprising: a controller for readingmanaging usage-license-information, the managing usage licenseinformation including information indicating at least one condition forpermitting at least a part of the first data string to be played back orto be recorded and information indicating the part of the first datastring which is permitted to be played back or to be recorded based onthe at least one condition; a decomposer for decomposing, into frequencycomponents, the part of the first data string to be played back or to berecorded and a second data string, the second data string including datacomprising spectrum coefficient information of the frequency components;and a transformer for transforming the frequency components into a datasignal for playing back or for recording the part of the first datastring which is permitted, based on the usage license information, to beplayed back or to be recorded based.
 38. A computer-readable mediumcomprising a computer program product for performing, when executed by aprocessor, a data processing method for playing back or for recording afirst data string comprising a second data string, the methodcomprising: reading managing usage license information, the managingusage license information including information indicating at least onecondition for permitting at least a part of the first data string to beplayed back or to be recorded and information indicating the part of thefirst data string which is permitted to be played back or to be recordedbased on the at least one condition; decomposing, into frequencycomponents, the part of the first data string to be played back or to berecorded and a second data string, the second data string including datacomprising spectrum coefficient information of the frequency components;and transforming the frequency components into a data signal for playingback or for recording the part of the first data string which ispermitted, based on the usage license information, to be played back orto be recorded.
 39. The data processing apparatus according to claim 37,wherein the usage license information is encrypted.
 40. The dataprocessing apparatus according to claim 37, wherein the at least onecondition includes at least one of information indicating the number ofusages of the first data string, information indicating an expiry dateof the first data string, information indicating a period for which thefirst data string is used, and information indicating a time for whichthe first data string is used.
 41. The data processing apparatusaccording to claim 37, wherein the frequency components include at leastone of normalizing-coefficient information and quantizing-precisioninformation.
 42. The data processing apparatus according to claim 37,wherein a part of the data of the second data string comprises randomdata.
 43. The data processing apparatus according to claim 37, whereinthe first data string includes audio data.
 44. The data processingapparatus according to claim 37, wherein the second data string includesaudio data.
 45. A computer-readable medium according to claim 38,wherein the usage license information is encrypted.
 46. Acomputer-readable medium according to claim 38, wherein the at least onecondition includes at least one of information indicating the number ofusages of the first data string, information indicating an expiry dateof the first data string, information indicating a period for which thefirst data string is used, and information indicating a time for whichthe first data string is used.
 47. A computer-readable medium accordingto claim 38, wherein the frequency components include at least one ofnormalizing-coefficient information and quantizing-precisioninformation.
 48. A computer-readable medium according to claim 38,wherein a part of the data of the second data string comprises randomdata.
 49. A computer-readable medium according to claim 38, wherein thefirst data string includes audio data.